Embodied Conversation: Integrating Face and Gesture into Automatic Spoken Dialogue Systems
نویسنده
چکیده
In this chapter I’m going to discuss the issues that arise when we design automatic spoken dialogue systems that can use not only voice, but also facial and head movements and hand gestures to communicate with humans. For the most part I will concentrate on the generation side of the problem—that is, building systems that can speak, move their faces and heads and make hand gestures. As with most aspects of spoken dialogue, however, generation is no good without comprehension, and so I will also briefly discuss some of the issues involved in building systems that understand non-verbal communicative behaviors.
منابع مشابه
Towards Context-Based Visual Feedback Recognition for Embodied Agents
Head pose and gesture offer several key conversational grounding cues and are used extensively in face-to-face interaction among people. We investigate how contextual information can improve visual recognition of feedback gestures during interactions with embodied conversational agents. We present a visual recognition model that integrates cues from the spoken dialogue of an embodied agent with...
متن کاملMultimodal Interaction Control
No matter how well hidden our systems are and how well they do their magic un-noticed in the background, there are times when direct interaction between system and human is a necessity. As long as the interaction can take place unobtrusively and without techno-clutter, this is desirable. It is hard to picture a means of interaction less obtrusive and techno-cluttered than spoken communication o...
متن کاملTiming and Rhythm in Multimodal Communication for Conversational Agents
Synthesis of lifelike gesture is finding growing attention in human-computer interaction. In particular, synchronization of synthetic gestures with speech output is one of the goals for embodied conversational agents which have become a new paradigm for the study of gesture and for human-computer interface (Cassell et al., 2000). Embodied conversational agents are computer-generated characters ...
متن کاملEmbodied Affect in Tutorial Dialogue: Student Gesture and Posture
Recent years have seen a growing recognition of the central role of affect and motivation in learning. In particular, nonverbal behaviors such as posture and gesture provide key channels signaling affective and motivational states. Developing a clear understanding of these mechanisms will inform the development of personalized learning environments that promote successful affective and motivati...
متن کاملDialogue Systems that Can Handle Face-to-Face Joint Reference to Actions in Space
This talk introduces new research that works towards an overarching model of natural face-to-face conversation about spatially-located actions in the world, and then uses that model to implement a trustworthy embodied conversational agent to guide users' ongoing, real-world activities away from the desktop. Past research has demonstrated that the relationship between verbal and nonverbal behavi...
متن کامل